Papers with classification setting
Intent Features for Rich Natural Language Understanding (2021.naacl-industry)
Copied to clipboard
| Challenge: | generic dialog systems, or chatbots, are increasingly popular, but most industrial dialog systems are built for specific clients and use cases. |
| Approach: | They propose a new neural network architecture that allows for domain and topic agnostic properties of intents that can be learnt from syntactic cues only. |
| Outcome: | The proposed model improves on baselines for identifying intent features in a deployed, multi-intent natural language understanding module. |
Zero-Shot and Few-Shot Stance Detection on Varied Topics via Conditional Generation (2023.acl-short)
Copied to clipboard
| Challenge: | Existing work on stance detection focuses on in-domain or leave-out targets with only a few target choices. |
| Approach: | They propose to use a conditional generation framework to denoise from partially-filled templates to better utilize the semantics among input, label, and target texts. |
| Outcome: | The proposed method significantly outperforms strong baselines on VAST and achieves new state-of-the-art performance. |
WER-BERT: Automatic WER Estimation with BERT in a Balanced Ordinal Classification Paradigm (2021.eacl-main)
Copied to clipboard
| Challenge: | Automatic Speech Recognition (ASR) systems are evaluated using Word Error Rate (WER) a higher WER means a lower percentage of errors between the ground truth and the transcription of the system. |
| Approach: | They propose a new balanced paradigm for automatic Word Error Rate estimation using a Librispeech dataset and a Google Cloud's Speech-to-Text API. |
| Outcome: | The proposed approach is more effective than regression in a classification setting, but suffers from heavy class imbalance. |
Contrastive Training Improves Zero-Shot Classification of Semi-structured Documents (2023.findings-acl)
Copied to clipboard
| Challenge: | Xu et al., 2020 focus on semi-structured document classification in a zero-shot setting . positional, layout, and style information play a vital role in interpreting such documents . |
| Approach: | They propose a matching-based approach that relies on a pairwise contrastive objective for pretraining and fine-tuning. |
| Outcome: | The proposed method significantly improves Macro F1 in the zero-shot learning setting. |
Fair Without Leveling Down: A New Intersectional Fairness Definition (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to capture intersectional group fairness lack significant unfairness at intersection levels. |
| Approach: | They propose a new definition of intersectional fairness that combines absolute and relative performance across sensitive groups. |
| Outcome: | The proposed definition does not improve on a simple baseline. |